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(54) Produce data collector and produce recognition system 



(57) A produce data collector with minimal spectral 
distortion. line produce data collector includes a light 
pipe having entrance and exit ends through which a por- 
tion of light reflected from a produce item travels, and a 
spectrometer adjacent the exit end of the light pipe 
which splits the portion of light into a plurality of wave- 
lengths and which produces signals associated with the 
wavelengths for identifying the produce item. 
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Description 

[0001] The present invention relates to product 
checkout devices and more specifically to a produce 
data collector and produce recognition system. 5 
[0002] Bar code readers are well known for their 
usefulness in retail checkout and inventory control. Bar 
code readers are capable of identifying and recording 
most items during atypical transaction since most items 
are labeled with bar codes. io 
[0003] Items which are typically not identified and 
recorded by a bar code reader are produce items, since 
produce items are typically not labeled with bar codes. 
Bar code readers may include a scale for weighing pro- 
duce items to assist in determining the price of such 15 
items. But identification of produce items is still a task 
for the checkout operator, who must identify a produce 
item and then manually enter an item identification 
code. Operator identification methods are slow and inef- 
ficient because they typically involve a visual compari- 20 
son of a produce item with pictures of produce items, or 
a lockup of text in table. Operator identification methods 
are also prone to error, on the order of fifteen percent. 
[0004] Therefore, it would be desirable to provide a 
produce data collector and produce recognition system. 25 
It would also be desirable to provide a spectrometer- 
equipped produce data collector which operates with 
minimal spectral distortion. 

[0005] In accordance with the teachings of the 
present invention, a produce data collector and produce 30 
recognition system are provided. 

[0006] The produce data collector includes a light 
pipe having entrance and exit ends through which a por- 
tion of light reflected from a produce item travels, and a 
spectrometer adjacent the exit end of the light pipe 35 
which splits the portion of light into a plurality of wave- 
lengths and which produces signals associated with the 
wavelengths for identifying the produce item. 
[0007] The light pipe may be a hollow light pipe or a 
light rod. 40 
[0008] An example spectrometer includes a linear 
variable filter, and a photodetector array adjacent the 
linear variable filter. 

[0009] The produce data collector may additionally 
include a lens adjacent an entrance end of the light pipe 45 
which focuses the portion of light at the entrance end of 
the light pipe. 

[0010] Use of such a light pipe in the produce data 

collector reduces the field-of-view effect and improves 
the light collection efficiency from a produce item to the 50 
spectrometer without increasing the incident angle of 
light onto the spectrometer. 

[0011] The invention also resides in a produce rec- 
ognition system comprising the above produce data col- 
lector, 55 

control circuitry which converts the signals to a 
spectrum of digital signals; and a computer which 
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compares the spectrum of digital signals to refer- 
ence spectra to identify the produce item. 

[0012] From a further aspect, the invention resides 
in a method of collecting produce data from a produce 
item comprising the steps of: 

illuminating the produce item; 

mixing a portion of light reflected from the produce 

item; 

splitting the portion of light into a plurality of wave- 
lengths; and 

producing signals associated with the wavelengths 
for identifying the produce item. 

[0013] The reflected light is preferably focused at 
the entrance of the light pipe and light of different angles 
reflected from the produce item by the light pipe is 
mixed 

[0014] The signals associated with the wavelengths 
may be converted to a spectrum of digital signal which 
is then compared with reference spectra to identify the 
produce item. 

[0015] Additional benefits and advantages of the 
present invention will become apparent to those skilled 
in the art to which this invention relates from the subse- 
quent description of the following embodiments of the 
invention and the appended claims, taken in conjunction 
with the accompanying drawings, in which: 

Fig. 1 is a block diagram of a transaction processing 
system including a produce recognition system; 
Fig. 2 is a block diagram of a type of produce data 
collector which collects spectral data; 
Fig. 3 is a first diagrammatic illustration of the oper- 
ation of a light pipe within the produce data collec- 
tor; 

Fig. 4 is a second diagrammatic illustration of the 

operation of the light pipe with a condenser lens 

within the produce data collector; 

Fig. 5A is a side view illustrating the mounting of the 

light pipe with a spectrometer; 

Fig. 5B is a front view illustrating the attachment of 

the light pipe with the spectrometer; and 

Fig. 6 is an exploded view of the light pipe. 

[0016] Referring now to Fig. 1, transaction process- 
ing system 10 includes bar code data collector 12, pro- 
duce data collector 14, and scale 16. 
[001 7] Bar code data collector 1 2 reads bar code 22 
on merchandise item 32 to obtain an item identification 
number, also know as a price look-up (PLU) number, 
associated with item 32. Bar code data collector 1 2 may 
be any bar code data collector, including an optical bar 
code scanner which uses laser beams to read bar 
codes. Bar code data collector 12 may be located within 
a checkout counter or mounted on top of a checkout 
counter. 
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[0018] Produce data collector 14 collects data for 

produce item 1 8 or any other non-barcoded merchan- 
dise item. Such data preferably includes color and color 
distribution data, but may also include size data, shape 
data, surface texture data, and aromatic data. Refer- 
ence produce data 30 is collected and stored. 
[0019] During a transaction, operation of produce 
data collector 14 may be initiated by placement of pro- 
duce item 1 8 on scale 1 6 or in by operator-initiated com- 
mands from transaction terminal 20. 
[0020] Scale 16 determines a weight for produce 
item 18. Scale 16 works in connection with bar code 
data collector 12, but may be designed to operate and 
be mounted separately. Scale 1 6 sends weight informa- 
tion for produce item 18 to transaction terminal 20 so 
that transaction terminal 20 can determine a price for 
produce item 18 based upon the weight information. 
[0021 ] Bar code data collector 1 2 and produce data 
collector 14 operate separately from each other, but 
may be integrated together. Bar code data collector 12 
works in conjunction with transaction terminal 20 and 
transaction server 24. 

[0022] In the case of bar coded items, transaction 
terminal 20 obtains the item identification number from 
bar code data collector 12 and retrieves a correspond- 
ing price from PLU data file 28 through transaction 
server 24. 

[0023] In the case of non-bar coded produce items, 
transaction terminal 20 executes produce recognition 
software 21 which obtains produce characteristics from 
produce data collector 14, identifies produce item 18 by 
comparing produce data in produce data 30 with col- 
lected produce data, retrieves an item identification 
number from produce data 30, retrieves a correspond- 
ing unit price from PLU data file 28 and calculates the 
total price of produce item 1 8 with the weight from scale 
16. 

[0024] In an alternative embodiment, identification 
of produce item 18 may be handled by transaction 
server 24. Transaction server 24 receives collected pro- 
duce characteristics and compares them with produce 
data in produce data 30. Following identification, trans- 
action server 24 obtains a price for produce item 1 8 and 
forwards it to transaction terminal 20. 
[0025] Storage medium 26 preferably includes one 
or more hard disk drives. PLU data file 28 and produce 
data 30 are stored within storage medium 26, but either 
may also be located instead at transaction terminal 20, 
or bar code data collector 12. 

[0026] To assist in proper identification of produce 
items, produce recognition software 21 may additionally 
display candidate produce items for operator verifica- 
tion. Produce recognition software 21 preferably 
arranges the candidate produce items in terms of prob- 
ability of match and displays them as text and/or color 
images on an operator display of transaction terminal 
20. The operator may accept the most likely candidate 
returned by or override it with a different choice. 



[0027] Turning now to Fig. 2, produce data collector 
14 primarily includes light source 40, optional con- 
denser lens 42, light pipe 44, spectrometer 51, control 
circuitry 56, transparent window 60, and housing 62. 

5 [0028] Light source 40 produces light 70. Light 
source 40 preferably produces a white light spectral dis- 
tribution, and preferably has a range from four hundred 
400nm to 700nm, which corresponds to the visible 
wavelength region of light. 

10 [0029] Light source 40 preferably includes one or 
more light emitting diodes (LEDs). A broad-spectrum 
white light producing LED, such as the one manufac- 
tured by Nichia Chemical Industries, Ltd., is preferably 
employed because of its long life, low power consump- 

15 tion, fast turn-on time, low operating temperature, good 
directivity. Alternate embodiments include additional 
LEDs having different colors in narrower wavelength 
ranges and which are preferably used in combination 
with the broad-spectrum white light LED to even out var- 

20 iations in the spectral distribution and supplement the 
spectrum of the broad-spectrum white light LED. 
[0030] Other types of light sources 40 are also envi- 
sioned by the present invention, although they may be 
less advantageous than the broad spectrum white LED. 

25 For example, a tungsten-halogen light may be used 
because of its broad spectrum, but produces more heat. 
[0031] A plurality of different-colored LEDs having 
different non-overlapping wavelength ranges may be 
employed, but may provide less than desirable collector 

30 performance if gaps exist in the overall spectral distribu- 
tion. 

[0032] Condenser lens 42 and light pipe 44 reduce 
spectral distortion by minimizing field-of-vlew (FOV) 
effect. 

35 [0033] Spectrometer 51 includes light separating 

element 52 and photodetector array 54. 
[0034] Light separating element 52 splits light 76 in 
the preferred embodiment into light 80 of a continuous 
band of wavelengths. Light separating element 52 is 

40 preferably a linear variable filter (LVF) 90, such as the 
one manufactured Optical Coating Laboratory, Inc. LVF 
90 offers continuous spectral coverage within the visible 
wavelength range (400-700nm). LVF 90 is preferably 
mounted on photodetectory array 54. 

45 [0035] Photodetector array 54 produces waveform 
signals 82 containing spectral data. The pixels of the 
array spatially sample the continuous band of wave- 
lengths produced by light separating element 52, and 
produce a set of discrete signal levels. Photodetector 

50 array 54 is preferably a complimentary metal oxide sem- 
iconductor (CMOS) array, but could be a Charge Cou- 
pled Device (CCD) array. 

[0036] Control circuitry 56 controls operation of pro- 
duce data collector 14 and produces digitized produce 
55 data waveform signals 84. For this purpose, control cir- 
cuitry 56 includes an analog-to-digital (A/D) converter. A 
twelve bit A/D converter with a sampling rate of 22- 
44kHz produces acceptable results. 
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[0037] Transparent window 60 may include an anti- 
reflective coating to reduce tine reflection of liglit 72, 
whicli may add bacl^g round liglit noise to light 74. 
[0038] Housing 62 contains light source 40, con- 
denser lens 42, light pipe 44, spectrometer 51 , photode- 5 
tector array 54, control circuitry 56, and transparent 
window 60. 

[0039] In operation, an operator places produce 
item 1 8 on window 60. Control circuitry 56 turns on light 
source 40. Light separating element 52 separates io 
reflected light 74 into different wavelengths to produce 
light 80 of a continuous band of wavelengths. Photode- 
tector array 54 produces waveform signals 82 contain- 
ing produce data. Control circuitry 56 produces digitized 
produce data signals 84 which it sends to transaction 15 
terminal 20. Control circuitry 56 turns off light source 40 
and goes into a wait state. 

[0040] Transaction terminal 20 uses produce data 
in digitized produce data signals 84 to identify produce 

item 1 8. Here, produce data consists of digitized wave- 20 
forms which transaction terminal 20 compares to refer- 
ence digitized waveforms stored within produce data 
30. After identification, transaction terminal 20 obtains a 
unit price from PLU data file 28 and a weight from scale 
16 in order to calculate a total cost of produce item 18. 25 
Transaction terminal 20 enters the total cost into the 
transaction. 

[0041] With reference to Figs. 3 and 4, an LVF- 
equipped spectrometer 51 is shown in more detail. One 
important characteristic of such an LVF-equipped spec- 30 
trometer 51 is that the physical position along the length 
of LVF 90 corresponds to wavelengths. This character- 
istic results in a field-of-view (FOV) effect. 
[0042] In simple terms, a window of finite size 
causes distortion in a measured waveform. This distor- 35 
tion is mainly caused by two factors: 1 ) the arrival of rays 
from one point on window 60 at different points on LVF 
90 with different distances and incident angles (radio- 
metric effect), and 2) the wavelength shift of the filtering 
band of LVF 90 for non-normal incident rays. 40 
[0043] Such distortion could be very significant 
when the distance between window 60 and LVF 90 is 
small. However, for optimal efficiency and compactness, 
it would be desirable to place LVF 90 as close to window 
60 as possible. To reduce the FOV effect, the distance 45 
between window 60 and LVF 90 must be many times 
larger than both the sizes of window 60 and LVF 90. 
[0044] With reference to Fig. 3, the present inven- 
tion reduces the FOV effect and hence improves the 
performance. The incident angles of all rays will not 50 
change when they travel through light pipe 44, but the 
position of rays with different incident angles from any 
given point at window 60 will be mixed at exit face 92 of 
light pipe 44. Making light pipe 44 longer improves mix- 
ing. Though the optical path traveled by light 74 is 55 
increased by light pipe 44, the length of light pipe 44 
itself does not reduce efficiency. The physical dimen- 
sions of produce data collector 14 can be reduced by 



folding the optical path of light 74 by folding light pipe 
44. 

[0045] With reference to Fig. 4, light pipe 44 may be 
used with or without condenser lens 42. Condenser lens 
42 improves efficiency by focusing light 74 at entrance 
surface 94 of light pipe 44, but increases the range of 
incident angles of light 74 onto the LVF. However, due to 
the mixing effect of light pipe 44, the FOV effect at exit 
face 92 of light pipe 44 is reduced to a pure smoothing 
effect on the spectrum. This is equivalent to a reduced 
spectral resolution of LVF 90. If the spectra from pro- 
duce item 18 are smooth and continuous, a slightly 
lower wavelength resolution may still be adequate. The 
smoothing effect can be controlled by limiting the maxi- 
mum incident angle Of^gx- example, the maximum 
incident angle can be set to the acceptance angle of the 
light separating element 52, in which case the smooth- 
ing effect will be negligible. 

[0046] In the embodiment of Fig. 3, maximum inci- 
dent angle B^^ix limited by the acceptable minimum 
distance from window 60 to LVF 90 for a certain window 
size. 

[0047] In the embodiment shown in Fig. 4, maxi- 
mum incident angle 9max 's determined by the size of 
lens 42 and the distance from lens 42 to the entrance of 
light pipe 44. 

[0048] A practical light pipe design for embodi- 
ments OF Figs. 3 and 4 is illustrated in Figs. 5A, 5B, and 
6. With reference to Figs. 5A and 5B, LVF 90, photode- 
tector array 54, and light pipe 44 are mounted to printed 
circuit board 96. 

[0049] With reference to Fig. 6, light pipe 44 is hol- 
low and includes two halves 98 and 100. The inner sur- 
faces of halves 98 and 100 are of optical quality and are 
highly reflective. The inner surfaces include a reflective 
coating 108, such as enhanced aluminum. The outer 
surfaces have no optical functional requirements. The 
seams where halves 98 and 100 join should be orien- 
tated perpendicular to the linear dimension of LVF 90 in 
order to minimally effect the accuracy of LVF 90. 
[0050] Fabrication can be simple and cost-effective. 
Halves 98 and 1 00 can be formed from injection mold- 
ing pr compression molding. Reflective coating 108 may 
be applied using evaporative coating techniques. 
[0051] As shown in Fig. 6, the two halves can be the 
same mechanical part. Pins 102 and holes 104 are 
arranged diagonally. Adhesive can be used to keep 
halves 98 and 1 00 together. Screws may also be used 
to fasten halves 98 and 100 together. Snap-in features 
may be added to the halves 98 and 1 00 so that they can 
be snapped together. Each of halves 98 and 100 has 
holes 106, which may be threaded, for fastening light 
pipe 44 to printed circuit board 96. 
[0052] Referring now to Fig. 7, a third embodiment 
uses light pipe 44 itself to limit the maximum incident 
angle 9pnax onto LVF 90. Since the acceptance angle of 
LVF 90 is usually less than twenty degrees, a polished 
glass cylinder or rod may be used as light pipe 44, utiliz- 
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ing its total internal reflection. In this embodiment, light 
pipe 44 is a light rod made of optical material with an 
index of refraction n-|, such as optical glass or optical 
plastic. The outer surface of the solid pipe is optically 
smooth and coated with a thin layer 110 of another 
material of slightly lower index of refraction n2. When a 
light ray strikes the interface of the two materials it will 
undergo total internal reflection (TIR) if its angle is less 
than maximum incident angle Bmax^ where G^ax 
degrees) is given by 

e_ = 90-sin-g) 

All rays that have angles greater than 6max will transmit 
through the interface and preferably be absorbed by the 
light absorbing material. In this embodiment, light pipe 
44 can be positioned much closer to window 60 
because light with large angles is filtered out by light 
pipe 44. Light collection efficiency is much higher. 
[0053] For all three embodiments, the diameter of 
light pipe 44 should be slightly larger than the length of 
LVF 90. LVF 90 should be placed as close as possible 
to, optimally adjacent to, exit face 92. 
[0054] Optimal length L of light pipe 44, is deter- 
mined by three factors: 1) maximum incident angle 
6max' 2) diameter D of light pipe 44, and 3) light pipe 
folding factor N: 

(N-1)x=ta"9max- 



[0055] Light pipe folding factor N is a measure of 
mixing. If the ray with the largest incident angle is folded 
N-1 times in light pipe 44, the rays will be mixed approx- 
imately N times at exit face 92. For any given point on 
window 60, there are N rays with different incident 
angles that will be mixed at any given point on LVF 90. 
Without light pipe 44, there is no mixing; only one ray 
goes from a given point on window 60 to a given point 
on LVF 90. A light pipe folding factor greater than four 
significantly reduces the FOV effect. 
[0056] The discussion above is also valid for 
skewed rays. 

[0057] Although the invention has been described 
with particular reference to certain preferred embodi- 
ments thereof, variations and modifications of the 
present invention can be effected within the scope of the 
following claims. 

Claims 

1 . A produce data collector comprising: 

a light pipe having entrance and exit ends 
through which a portion of light reflected from a 



produce item travels; and 

a spectrometer adjacent the exit end of the light 
pipe which splits the portion of light into a plu- 
rality of wavelengths and which produces sig- 
5 nals associated with the wavelengths for 

identifying the produce item. 

2. The produce data collector as recited in claim 1 , 
wherein the spectrometer comprises: 

10 

a linear variable filter; and 
a photodetector array adjacent the linear varia- 
ble filter. 

15 3. The produce data collector as recited in claim 1, 
wherein the light pipe comprises a hollow cylinder. 

4. The produce data collector as recited in claim 3, 
wherein the light pipe has an inner surface and fur- 

20 ther comprises a reflective layer on the inner sur- 
face. 

5. The produce data collector as recited in claim 1, 
wherein the light pipe comprises a light rod. 

25 

6. The produce data collector as recited in claim 5, 
wherein the light pipe has an index of refraction and 
an outer surface, and wherein the light pipe further 
comprises a layer of material having an index of 

30 refraction which is lower than the index of refraction 
of the light pipe. 

7. The produce data collector as recited in claim 1 , fur- 
ther comprising: 

35 

a lens adjacent the entrance end of the light 
pipe which focuses the portion of light at the 
entrance end of the light pipe. 

40 8. The produce data collector as recited in claim 1 , fur- 
ther comprising: 

a light source for illuminating the product item; 
and 

45 control circuitry which controls the light source 

and which converts the signals to digital sig- 
nals. 

9. A produce recognition system comprising: 

50 

a produce data collector according to any of 
claims 1 to 7; 

control circuitry which converts the signals to a 
spectrum of digital signals; and 
55 a computer which compares the spectrum of 

digital signals to reference spectra to identify 
the produce item. 
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10. A produce recognition system comprising: 

a produce data collector according to any of 
claims 1 to 7; 

control circuitry which converts the signals to a 5 
spectrum of digital signals; and 
a computer which compares the spectrum of 
digital signals to reference spectra to identify 
the produce item. 

10 

1 1 . A method of collecting produce data from a produce 
item comprising the steps of: 

illuminating the produce item; 

mixing a portion of light reflected from the pro- is 

duce item; 

splitting the portion of light into a plurality of 
wavelengths; and 

producing signals associated with the wave- 
lengths for identifying the produce item. 20 

12. The method according to claim 1 1 , further compris- 
ing the step of: 

focusing the reflected light at the entrance of 25 
the light pipe. 

13. A method according to claim 1 1 , wherein the step of 
mixing comprises mixing light of different angles 
reflected from the produce item by a light pipe; 30 

14. A method according to any of claims 11 to 13, fur- 
ther comprising: 

converting the signals associated with the 35 
wavelengths to a spectrum of digital signals; 
and 

comparing the spectrum of digital signals to 
reference spectra to identify the produce item. 

40 
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